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19.  Abstract  (Continued) 

Under  the  outlined  restriction,  the  problem  can  be  reduced  to  an  ordinary  least  squares 
formulation  for  which  software  is  available.  ,< 

V  ~~ 

Application  of  the  new  method  is  illustrated  by  two  examples.  In  one  example,  we  are 
concerned  with  the  hazards  caused  by  enemy  fire  on  armor.  An  important  item  of  information 
for  the  assessment  of  the  involved  risks  is  a  predictive  model  for  the  hole  size  in  terms 
of  physical  properties  of  the  projectile  and  target  plate,  respectively.  We  use  a 
non-linear  fuzzy  model  function  for  this  analysis.  The  second  example  is  taken  from 
Heshmaty  and  Kandel.t-^J  In  this  example,  the  fuzzy  model  permits  one  to  estimate  the 
risks  of  economical  prediction.  The  example  is  of  theoretical  interest  because  it  allows 
one  to  compare  the  new  method  with  a  previously  developed  method  by  Tanaka  et  al.i^J 
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1.  INTRODUCTION 


We  consider  model  fitting  problems  in  which  the  data  are  crisp 
vectors  and  the  model  is  a  fuzzy  function,  scalar  or  multi-dimensional.  This 
type  of  fuzzified  model  fitting  is  attractive  in  situations  where  data 
membership  functions  are  not  available,  but  the  model  fitting  problem 
nevertheless  is  considered  as  fuzzy.  The  problem  is  in  a  sense 
complementary  to  the  case  where  the  data  are  fuzzy  and  the  fitting  function  is 
assumed  to  be  crisp.  Problems  of  that  type  were  considered  by  CelmipS  [3]. 
In  both  cases  the  result  of  the  fitting  is  a  fuzzy  function. 

This  paper  presents  an  efficient  method  for  the  determination  of  the 
model  function  which  is  generally  assumed  to  be  a  non-linear  and  implicit 
vector  function.  The  efficiency  of  the  method  is  achieved  by  imposing 
restrictions  on  the  problem  formulation.  First,  membership  functions  of  fuzzy 
points  always  are  assumed  to  be  conical  functions.  (These  functions  are 
defined  in  Section  2).  Second,  the  model  function  is  assumed  to  be  a  fuzzy 
set  whose  elements  are  defined  in  terms  of  a  fuzzy  parameter  vector.  Finally, 
the  model  fitting  is  done  in  a  least  squares  sense  by  minimizing  the  squares  of 
deviations  from  one  of  the  fitted  function's  membership  values  at  the 
observed  points. 

The  restriction  to  model  parameter  vectors  with  conical  membership 
functions  likely  is  of  minor  importance  because  of  the  general  uncertainty  of 
the  particulars  of  the  fuzziness  of  the  fitting  function.  As  far  as  the  least 
squares  minimization  is  concerned,  only  experience  with  fuzzy  model  fitting 
may  show  whether  other  objective  functions  than  the  sum  of  squares  yield 
more  desirable  results. 


The  similarity  of  problems  with  fuzzy  models  and  crisp  data  on  one 
hand  and  crisp  models  and  fuzzy  data  on  the  other  hand  stems  from  the  fact 
that  in  an  implicitly  formulated  model  function  F(X,t)  =  0,  where  X  is  the 
observable  vector  and  t  is  the  parameter  vector,  one  does  not  need  to 
distinguish  between  "observable"  and  "parameter"  arguments.  Therefore,  the 
roles  of  these  arguments  formally  can  be  interchanged,  and  the  fitting  of  a 
fuzzy  model  treated  as  data  fitting  in  the  space  of  parameters.  As  a 
consequence,  problems  of  both  types  can  be  handled  numerically  by  similar 
algorithms  and  software  with  only  minor  modifications.  The  interpretation  of 
the  results  is  of  course  different  in  the  two  cases.  Also,  in  the  here 
considered  case  with  fuzzy  model  functions,  one  typically  does  not  a  priori 
know  the  spread  characteristics  of  the  model,  which  are  needed  as  input  for 
the  solution  algorithms.  The  determination  of  these  characteristics  therefore 
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requires  an  iteration  which  is  not  needed  in  problems  with  fuzzy  data  and 
crisp  models. 

In  Section  2  the  basic  definitions  are  provided  of  fuzzy  vector 
spaces  and  fuzzy  functions  with  conical  membership  functions.  The  least 
squares  model  fitting  problem  is  formulated  in  Section  3.  Section  4  discusses 
the  determination  of  the  spread  of  the  fitted  model.  Examples  are  presented 
in  Section  5,  and  Section  6  contains  a  summary  of  the  results  and  conclusions. 

2.  FUZZY  VECTORS  AND  FUZZY  FUNCTIONS 

We  define  a  fuzzy  n -component  vector  A  as  a  set  of  vectors  with 
the  membership  function  In  this  paper,  we  assume  that  the  membership 
function  of  a  vector  always  is  a  conical  function  which  we  define  as  follows. 

Let  A  be  a  crisp  point  in  Rn,  and  let  be  a  positive  definite 
(n  x  n)-matrix  associated  with  A.  Let  II  ■  11^  be  the  elliptic  norm 

\\X-A\\a  =  [(X-AfP^iX-A)]^  (2.1) 

of  the  distance  between  an  arbitrary  XiR„  and  A.  Using  this  norm,  we 
define  a  conical  membership  function  \xA  by 

HA(X)  =  1  -  min{  1,  II  X  -  All^}  .  (2.2) 

The  fuzzy  vector  A  with  the  membership  function  (2.2)  is  thus  specified  by  A 
and  PA : 

A  =:{  A  ,  PA}  .  (2.3) 

We  call  A  the  apex  of  A  and  PA  its  panderance  matrix. 

In  Rj,  the  conical  membership  function  is  the  triangular  function 

M*)  =  1  -  min  { 1  ,  |x-«|/sfl}  ,  (2.4) 

where  sa  -  V^V  *n  ^2'  P-a  is  a  cone  as  shown  in  Figure  1.  The  membership 
function  of  each  component  of  A  is  a  triangular  function  with  a  spread  which 
equals  the  square  root  of  the  corresponding  diagonal  element  of  PA.  The 
bases  of  the  triangles  are  twice  the  spreads.  The  boundary  of  the  support  of 
\iA  and  the  level  surfaces  \xA  =  constant  are  hyperellipsoids  in  R„. 

Now  we  consider  a  space  of  fuzzy  vectors.  The  distance  norm  (2.1) 
is  not  a  convenient  measure  for  the  separation  of  two  fuzzy  vectors,  because 
in  general  II  B  -  A  1!^  #  I!  A  -  B  li  g-  Therefore  we  introduce  the  concept  of  a 
discord  between  two  fuzzy  vectors  by  the  definition 
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D(A,B)  =  min  max  {  II X  -  AlA  ,  IIX  -  Blig}  .  (2.5) 

X  f  R| 

The  discord  is  a  symmetric  function  of  A  and  B,  it  is  positive  if  A*  B,  and  it 
vanishes  only  if  A  -  B .  However,  it  is  not  a  distance  in  the  sense  of  functional 
analysis,  because  it  does  not  satisfy  the  triangle  inequality.  We  may  consider 
a  crisp  vector  as  the  limit  of  a  fuzzy  vector  when  its  panderance  matrix 
approaches  a  zero-matrix.  The  corresponding  limit  of  the  discord  is  the 
distance  (2.1),  that  is, 

lim  D(A,B)  =  \\A-B llB  .  (2.6) 

A- A 

The  discord  D(A,B)  is  less  than  one  if  and  only  if  the  supports  of  the 
membership  functions  of  A  and  B  intersect. 

Another  relation  between  two  fuzzy  vectors  is  the  grade  of 
collocation.  We  define  it  by 

■Y(A,B)  =  max  min{  »tA(X)  ,  »iB(X)  }  .  (2.7) 

X  (R, 

For  vectors  with  conical  membership  functions  one  has  the  following  relation 
between  y  and  D 

y(A,B)  =  1  -  min  {  1  ,  D(A,B)  }  .  (2.8) 

Now  we  consider  a  fuzzy  r-component  function  F(X),  and  define  it 
as  a  fuzzy  set  of  functions.  In  this  paper,  we  only  consider  fuzzy  functions 
that  are  defined  in  terms  of  a  fuzzy  p-component  parameter  vector  T ,  that  is, 

F(X)  =  F(X,T)  (2.9) 


T  =  : {T  ,  PT} 


(2.10) 


Each  element  t  of  the  fuzzy  set  T  defines  an  element  F(X,Q  of  the  fuzzy 
function  set  F.  The  membership  value  of  t  is  according  to  Eq.  (2.2) 


\LT(t)  =  1  -  min  {  1  ,  lit  — T I! j  }  , 


(2-11) 


where  the  norm  lit  -  T  j  is  defined  by  Eq.  (2.1).  We  assign  to  the  element 
F(X,t)  of  F  the  same  membership  value: 


ji(  F(X,t)  )  =  nT(t)  . 


(2.12) 


The  crisp  equation  F(X,T)  =  0  defines  in  R„  a  (n  -  r)-dimensional 
hypersurface.  The  fuzzy  equation 
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has  as  a  solution  in  R„  a  fuzzy  set  Xp,  which  may  be  geometrically 
interpreted  as  a  fuzzy  hypersurface.  The  solution  of  fuzzy  equations  is 
discussed  in  Appendix  A  where  we  introduce  the  concept  of  a  separation 
h(X,Xp)  between  a  crisp  XtRn  and  Xp  and  define  it  as  (see  Eq.  (A. 13)) 


h{X,XF)  = 


mm 

t  :  F(X,t)’ 


iit-Tllp 


(2.14) 


If  Xp  is  a  fuzzy  point  A  (i.e.,  a  fuzzy  vector),  then  the  separation  h(X,A) 
equals  the  norm  II  X  —  A  11^,  defined  by  Eq.  (2.1).  A  generalization  to  solution 
sets  Xp  which  are  not  vectors  yields  the  approximate  formula  (A. 20) 

h(X,Xp)  =  [  Fr  (FtPpFj)-1  F  )m  ,  (2.15) 

where  Ft  =  dF/dt,  and  the  functions  F  and  Ft  are  evaluated  at  (X,T).  For 
non-linear  F,  the  approximation  may  be  used  if  r=l  and,  with  restrictions,  if 
r>l.  The  linearization  on  which  the  approximate  formula  is  based  is  usually 
not  appropriate  if  r  =  n . 

The  definition  of  a  separation  between  crisp  points  and  the  fuzzy 
set  Xp,  and  crisp  points  and  a  fuzzy  point  A  permits  one  to  define,  in 
generalization  of  Eq.  (2.5),  the  discord  between  Xp  and  A: 


D(A,X F)  =  min  max  {  h{X,A)  ,  h(X,Xp)  }  . 
X  ( R. 


(2.16) 


If  the  solution  Xp  of  Eq.  (2.13)  is  not  a  point,  then  the  discord  D(A,Xp)  can 
be  computed  by  an  approximate  formula,  also  derived  in  Appendix  A.  For 
that  approximation  one  first  computes  the  separation  between  a  particular 
point  X^  and  A  using  the  formula 

h{XA,A)  =  [  Ft  (FxPaFtx)~1  F  ,  (2.17) 

where  Fx  =  dF/dX  and  the  functions  F  and  Fx  are  evaluated  at  (A,T).  Then 

h(XA,A)  ■  h(A,Xp)  „  „ 


D(A,Xf)  = 


h(XA,A)  +  h(A,Xp) 


(2.18) 


The  separation  h(A,Xp)  in  Eq.  (2.18)  is  given  by  Eq.  (2.15).  If  either  A  or  Xp 
approaches  a  crisp  point,  then  the  discord  (2.16)  approaches  h(A,  Xp)  or 
h(A,Xp),  respectively. 

Using  the  discord  we  also  can  compute  the  grade  of  collocation 
between  the  fuzzy  point  A  and  the  fuzzy  hypersurface  Xp: 
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•y(A,Xf)  =  1  -  min{  1  ,  D(A,Xf)}  .  (2.19) 

This  relation  follows  from  the  definition  (2.7)  because  the  membership 
function  p.f  (X)  of  Xp  is  related  to  h(X,Xp)  by 

HF(X)=  1  -  min{  1  ,  h(X,XF)  }  .  (2.20) 

3.  FUZZY  MODEL  FITTING  AND  SOLUTION  ALGORITHM 


We  consider  the  following  general  type  of  model  fitting.  Let 
X,  €Rn,  i  =  1,2 ,...,s,  be  a  set  of  observation  vectors,  F,  (X,,  <)  €  Rr  be  a 
corresponding  set  of  model  functions,  and  W  be  an  objective  function.  The 
goal  of  the  model  fitting  is  to  find  a  model  parameter  vector  t  which 
approximately  satisfies  the  model  equations  F,  =  0  and  minimizes  the 
objective  function  W .  The  problem  is  completely  defined  by  providing  the 
sets  {X,,F,,W}  and  specifying  the  approximation  type  of  the  model  equations 
F,  =  0.  If  at  least  one  of  the  elements  of  the  sets  is  fuzzy,  then  the  solution 
of  the  problem  is  a  fuzzy  model  parameter  T,  and  consequently,  as  described 
in  Section  2,  the  fitted  model  functions  F,(X,T)  are  fuzzy  functions,  even  if 
the  a  priori  formulated  model  functions  F,(X,f)  were  crisp.  The  case  with 
fuzzy  X,  and  crisp  F,  was  treated  in  CelmigS  [3].  In  this  paper,  we  consider 
the  dual  case  where  the  observations  X,  are  crisp,  but  the  fitting  functions  F, 
are  fuzzy.  The  objective  in  this  case  is  to  find  for  each  X,  a  particular  element 
from  the  fuzzy  set  F,  such  that  the  model  equation  is  satisfied,  and  the 
element  has  a  high  membership  value. 


Let 


T  -  :  {  T  .  PT  }  (3.1) 

be  the  fuzzy  parameter  of  the  model  functions.  The  least  squares  problem  is 
formulated  as  follows: 


minimize 


subject  to 
and 


w=  2  i 
i  =  1 


2 


p.(  F,(X,,T  +  c,)  10)  , 


F ,(X,,T  +  c,)  —  0  ,  i  —  1,2, . . .  ,s 
(  F , (X, ,T  +  c,)  )  >  *y ,  ,  i  =  1,2, . . . ,  s. 


(3.2a) 


(3.2b) 


The  latter  condition  (3.2b)  is  a  minimum  requirement  for  the  quality  of  the 
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fitting  function,  expressed  as  a  required  membership  level  of  the  solution. 

Now  we  use  the  definition  (2.12)  of  the  membership  function  ji(F,) 
and  reformulate  Eq.  (3.2)  in  terms  of  jtj: 

minimize 

s 

W  =  2  t  1  -P-rOT+c,-)  ]  , 
i  —  1 

subject  to 

F,(X,-,T  +  Cj)  =  0,  i~  1,2,  ...,s 

and 

Hr(T+c,)  >  y,  ,  i  =  1,2,. ..,s.  (3.3b) 

In  Eqs.  (3.2)  and  (3.3)  T  +  c,  is  a  particular  element  of  the  fuzzy  set  T 
for  which  the  function  F,€F,  satisfies  the  constraints  at  X,.  The  minimization 
of  the  objective  function  selects  elements  T  +  c,  with  high  membership  values. 

The  solution  of  Eq.  (3.2)  or  (3.3)  can  be  found  by  solving  the 
following  related  problem: 

minimize 

s 

w  =  S  c»rp»'lc» 

i  =  1 

subject  to 

F,(X„T  +  c,)=  0,  i  —  1,2,  ...,s 

and 

c,T Pf ^  <  (1-y,)2,  i=  1,2 ,...,s.  (3.4b) 

Because  of  the  definition  (2.11)  of  jtj-,  the  solutions  of  (3.3)  and  (3.4)  are 
identical,  but  Eq.  (3.4)  is  better  suited  for  numerical  algorithms.  This  is  so 
because  the  objective  function  W  in  Eq.  (3.4)  is  well  defined  and  differentiable 
for  all  values  of  c,.  In  Eq.  (3.3),  the  objective  function  is  not  differentiable  as 
iLj  approaches  zero,  requiring  special  algorithms  to  handle  this  singularity. 

The  unknowns  in  Eq.  (3.4)  are  the  apex  T  of  T  and  the  elements 
T  +  c,  of  T.  A  simple  procedure  for  finding  the  unknowns  is  to  solve  Eq. 
(3.4a),  and  to  check  the  condition  (3.4b)  afterwards.  If  the  condition  is  not 
satisfied  for  many  observed  points  X,  (for  many  i  ),  then  this  is  an  indication 
that  the  model  functions  are  not  compatible  with  the  data.  In  this  case  one 
may  either  change  the  model,  or  dilate  or  adapt  the  spread  of  the  solution,  as 
described  in  Section  4.  If  the  condition  is  not  satisfied  at  only  a  few  points. 
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then  this  usually  indicates  outliers.  The  treatment  of  such  points  strongly 
depends  on  the  application  of  the  model  and,  therefore,  will  not  be  discussed 
here.  One  can  of  course  try  to  enforce  the  condition  (3.4b)  by  seeking  a 
solution  for  the  complete  system  (3.4a),  (3.4b).  However,  such  a  solution,  if  it 
exists,  will  have  undesirable  properties  in  most  cases,  because  it  particularly 
accommodates  outliers.  We  shall,  therefore,  restrict  our  discussion  in  this 
section  to  the  solution  of  Eq.  (3.4a). 

The  constrained  minimization  problem  (3.4a)  is  very  similar  to  an 
ordinary  least  squares  problem,  or  to  a  model  fitting  problem  with  fuzzy  data 
and  crisp  model.  The  latter  two  cases  only  differ  from  Eq.  (3.4a)  in  that  the 
constraint  equation  is 

F,(X,  +  c,,T)  =  0  (3.5) 

instead  of  F,(X,,  T  +  c,)  =  0,  as  in  Eq.  (3.4a).  Because  of  this  similarity,  the 
problem  can  be  numerically  solved  using  available  software  for  least  squares 
problems  with  implicit  model  equations  [2].  The  examples  in  Section  5  were 
solved  using  such  a  program,  COLSAC,  described  in  [1).  A  special  solution 
algorithm  for  problems  with  the  constraint  (3.4a)  is  described  in  Appendix  C. 
The  implementation  of  this  algorithm  by  COLSAC  does  not  require  any 
reprogramming,  however,  because  of  the  general  formulation  of  the  computer 
program. 

At  the  beginning  of  this  section  we  pointed  out  that  the  difference 
between  a  crisp  and  a  fuzzy  function  is  in  the  characteristics  of  the  function 
parameter  T.  If  T  is  crisp,  then  the  function  F,(X,T)  also  is  crisp,  and  if  T  is  a 
fuzzy  T,  the  F,(X,T)  is  a  fuzzy  function  F,(X).  Therefore,  a  "fuzzy  model" 
means  that  the  functions  F,  contain  a  fuzzy  unknown  parameter.  Its 
fuzziness  is  given  by  the  panderance  matrix  Pj.  Consequently,  we  assumed 
in  the  problem  formulation  that  Pj  is  given,  and  only  the  apex  T  of  T  is 
unknown. 

Such  a  problem  formulation  may  be  adequate  in  some  cases. 
However,  in  many  other  situations,  one  has  not  sufficient  information  on 
which  to  base  an  estimate  of  Pj  and,  therefore,  needs  a  process  by  which  Pj 
is  computed  concurrently  with  T.  We  propose  for  this  purpose  the  following 
iteration.  We  start  with  an  arbitrary  initial  approximation  Pj 0  of  Pj  and  solve 
Eq.  (3.4a)  obtaining  a  Tj  and  the  corresponding  c, .  We  then  calculate  a 
panderance  matrix  Pj-j  from  the  input  Pj-q  by  the  panderance  propagation 
formula.  (See  Eq.  (C.7)  in  Appendix  C).  Because  Pjq  and  Pj i  describe  the 
same  fuzzy  vector  T,  one  can  argue  that  both  should  be  equal.  Therefore,  at 
the  next  iteration  step  we  start  with  a  panderance  matrix  that  is  proportional 
to  Pj i,  and  repeat  the  process.  The  proportionality  factor  is  arbitrary  in  the 


sense  that  such  a  factor  does  not  influence  the  apex  T  of  the  solution  T .  A 
reasonable  factor  for  the  iteration  process  is  the  dilator  described  in 
Section  4.  This  factor  is  determined  such  that  the  spread  of  the  fuzzy  solution 
of  F,(X,  T)  *  0  is  just  large  enough  to  cover  the  observation  X,  if  Pj  is 
multiplied  by  In  general,  the  convergence  of  the  process  is  slow,  but 
high  accuracy  of  the  elements  of  Pj  usually  is  not  needed.  Because  of  this, 
the  convergence  end  conditions  should  be  formulated  in  terms  of  the 
components  of  the  apex  T  instead  of  the  elements  of  Pj.  Convergence 
acceleration  techniques,  e.g.,  overrelaxation  also  can  be  useful. 

4.  DILATION  AND  ADAPTATION  OF  THE  SPREAD  OF  THE  MODEL 

The  principal  result  of  the  model  fitting  described  in  Section  3  is  the 
fuzzy  model  parameter  f  =  :{r,Pr},  which  defines  the  fuzzy  functions 
F,(X)  =  F,(X,T).  However,  in  many  applications  one  is  not  interested  in 
these  functions  but  in  the  relations  between  the  components  of  X  which  are 
defined  by  the  equations 

F,(X,f)=  0.  (4.1) 

The  solution  of  Eq.  (4.1)  is  a  fuzzy  set  X  p,  in  R„  which  may  be  geometrically 
interpreted  as  a  fuzzy  (n  -  r)-dimensional  hypersurface  in  R„.  Some 

properties  of  X p,  are  discussed  in  Appendix  A,  where  it  is  shown  that  the 
apex  of  Xp,  is  independent  of  the  particular  form  of  Eq.  (4.1),  whereas  the 
spread  of  Xp,  depends  on  the  formulation  of  the  equation.  Therefore,  a 
discussion  of  the  spread  always  pertains  to  a  particular  formulation,  for 

instance  to  a  solution  of  Eq.  (4.1)  for  certain  components  of  X.  Now  we 

assume  that  a  formulation  adequate  for  applications  is  chosen  and 
represented  by  F(X,T)  =  0.  For  simplicity  we  omit  the  index  i.  The 

discussion  always  involves  one  particular  F,,  and  it  does  not  matter  whether 

all  the  F,  ■  F  or  are  different. 

According  to  the  problem  formulation  in  Section  3  we  would  like 
the  fuzzy  relation  (4.1)  between  components  of  X  be  such  that  the 

observations  X,  are  compatible  with  the  relations  at  least  to  a  grade  *y .  This 

requirement  is  expressed  by  Eqs.  (3.3b)  or  (3.4b)  as  constraints  for  the 

residuals  c,  of  the  parameter  vector.  In  these  formulations,  the  constraints  are 
independent  of  the  model  function  F  =  0.  Therefore,  the  following 
discussion  of  the  properties  of  the  solution  Xp  of  Eq.  (4  1)  is  applicable  not 
only  to  the  model  equation,  but  also  to  any  other  such  relation  between 
components  of  X  which  depends  on  T .  In  general  one  is  of  course  principally 
interested  in  the  model  function. 


In  terms  of  X  and  X F  the  condition  (3.2b)  means  that  the  discord 
between  X,  and  Xp  should  be  less  than  1  -  y,,  or  that  the  grade  of 
collocation  between  X,  and  Xp  should  be  larger  than  y,.  Hence  one  may  use 
the  grade  of  collocation  as  a  measure  of  compatibility  between  data  and  fitted 
model.  We  define  it  most  conveniently  in  terms  of  the  discord,  which  is 
according  to  Eq.  (2.15)  or  Eq.  (A. 20)  approximately  given  by 

D(X,  ,  Xf)«  (  Ft  (FtPrFlr1  F  ]M  ,  (4.2) 

where  F  and  Ft  are  evaluated  at  ( XitT ).  Then  the  grade  of  compatibility 
between  the  data  vector  X,  and  the  fitted  function  is 

y(X,  ,  Xf)  =  1  -  min  {  1  ,  D(X,  ,  Xf)  }  .  (4.3) 

In  terms  of  the  grade  of  compatibility,  the  condition  (3.2b)  simply  is 
y(X,,Xf)  >  y,.  The  global  grade  of  compatibility  between  data  and  model 
equation  we  define  as 

y  (  {X,}  ,  Xp  )  —  min{y(X,  ,  Xf)}  .  (4.4) 

'  i 

One  can  change  the  grade  of  compatibility  by  dilating  the  spread  of 
the  fuzzy  hypersurface  Xf.  The  spread  is  governed  by  the  parameter 
panderance  matrix  PT  and  by  the  form  of  the  Eq.  (4.1).  We  only  consider  the 
modification  of  the  spread  by  a  modification  of  Pj.  Let  PT  be  multiplied  by  a 
factor  4>,2.  Then  the  spread  of  f  is  multiplied  by  $>,,  and  so  is  the  discord 
D(Xj,Xf).  Hence,  if  one  wants  the  grade  of  compatibility,  Eq.  (4.3),  to  equal 
the  desired  grade  7,,  then  the  4>,  must  have  the  value 

<D,  =  D(X,  ,  Xf)/(l-7,)  (4.5) 

We  call  4>,  the  model  spread  dilator  for  the  data  point  X,.  The  global  model 
spread  dilator  we  define  by 

<J>  =  max  {<!>,  }.  (4.6) 

i 

The  dilators  depend  on  the  desired  grades  of  compatibility  7,.  For  7 ,  =  0  in 
Eq.  (4.5)  one  obtains  a  dilator  which  makes  the  spread  of  Xf  just  large 
enough  so  that  the  support  of  the  membership  function  of  Xf  includes  the 
observation  X,.  We  call  the  corresponding  global  dilator  $0  and  have  used  it 
in  Section  3  in  the  iteration  of  the  panderance  matrix  Pj . 

The  described  dilation  of  Pj  by  a  constant  factor  can  produce  in 
some  parts  of  the  model  spreads  which  are  too  large  to  be  consistent  with  the 
actual  discords  between  observations  and  model.  In  such  cases  the  model 
spread  may  be  adapted  by  making  <!>  a  function  of  X,  and  using  the  sets 


to  design  the  function  4>(X)  such  that 

1 i  =  1,2,...,  s.  (4.7) 

One  recognizes  that  the  constant  global  dilator,  Eq.  (4.6),  is  an  approximation 
of  the  function  $(X)  by  a  constant  <t>o- 

In  model  fitting  problems  where  the  data  are  fuzzy  one  has  three 
different  dilators,  namely  data  dilators,  minimal  model  dilators  and  inclusive 
model  dilators  [3].  In  the  present  case  with  crisp  data,  the  data  dilators 
formally  are  infinite  (to  fuzzify  the  crisp  data),  whereas  both  model  dilators 
are  equal.  Therefore,  one  only  has  one  dilator  type  if  the  data  are  crisp. 

5.  EXAMPLES 


We  present  two  examples  of  model  fitting  with  a  fuzzy  model  and 
crisp  data.  The  first  example  is  a  fitting  of  a  non-linear  function  to  data  from  a 
terminal  ballistics  problem.  The  second  example  is  an  economics  forecasting 
problem,  and  it  involves  a  linear  model  function.  In  the  latter  example  we 
compare  our  results  with  those  obtained  by  Heshmaty  and  Kandel  [4]  who 
used  a  method  developed  by  Tanaka  et  al.  [5],  which  is  based  on  an 
optimization  principle  that  is  different  from  ours. 

Now  we  consider  the  first  example.  For  the  assessment  of  effects  of 
weapons  one  needs  an  estimate  of  the  size  of  perforation  that  is  produced  by 
a  projectile  or  fragment  impacting  on  a  metal  plate.  The  size  of  the 
perforation  depends  on  the  material  properties  of  the  projectile  and  plate,  on 
the  geometry  of  the  projectile,  and  on  the  velocity  and  obliquity  of  the  impact. 
Shear  and  Dumer  [6]  have  shown  that  in  many  cases  the  ratio  of  the  hole  area 
to  projectile's  presented  area  is  an  increasing  function  of  the  dimensionless 
ballistic  damage  indicator 

B  =  KP/  (VP  OyT)  ,  (5.1) 

where  Kp  is  the  kinetic  energy  of  the  projectile,  Vp  is  its  volume  and  <ryj  is 
the  ultimate  yield  stress  of  the  target  material.  The  relation  between  the  ratio 
Aul  Ap  (crater  or  hole  area  by  projectile's  presented  area)  and  B  is  fuzzy  for 
two  reasons.  First,  it  has  no  firm  theoretical  foundations,  that  is,  no  particular 
form  of  the  model  function  is  suggested  by  a  theory  of  the  mechanics  of  the 
penetration  process.  Second,  the  observations,  i.e.,  the  measurements  of  the 
involved  quantities  also  are  fuzzy.  Particularly,  the  value  of  avj  is  usually 
only  approximately  known,  and  can  vary  considerably  from  specimen  to 
specimen  even  in  laboratory  environment.  The  other  quantities,  AH,  Ap,  Kp 
and  Vp  can  be  more  precisely  measured,  but  often  the  data  sources  do  not 
contain  sufficient  information  to  estimate  their  distributions  in  the  classical 
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Table  1.  Perforation  Data 


B 

VAP 

B 

I  AH/AP 

4.060 

1.148 

21.885 

2.599 

23.725 

2.549 

14.010 

2.098 

60.250 

4.774 

23.580 

2.737 

56.405 

5.244 

19.150 

2.518 

73.625 

6.786 

16.865 

2.381 

57.495 

5.148 

15.830 

2.184 

28.770 

3  065 

15.200 

2.064 

37.285 

3  513 

14.755 

2.016 

8.305 

1.209 

13.565 

1.995 

11.540 

2.044 

8.475 

1.571 

32.075 


4.315 


4.390 


1.409 


sense.  Hence,  although  it  is  known  that  the  data  are  fuzzy,  one  has  no 
means  to  estimate  their  spread.  This  is  a  typical  situation  where  one  would 
like  to  fit  a  fuzzy  model  to  data  which,  for  lack  of  better  information,  may  be 
treated  as  crisp. 


Table  1  contains  a  list  of  typical  experimental  data.  The  list  is  a 
subset  of  the  data  collected  by  Shear  and  Dumer  [6],  and  is  presented  for 
illustrative  purposes  only.  The  original  set  contains  over  400  observation 
pairs.  We  use  the  data  in  Table  1  to  illustrate  the  fitting  process  with  the 
following  non-linear  fuzzy  model  function 

AH/AP  =  VB/  ( oVB  +  l)  .  (5.2) 


The  numerical  solution  of  the  model  fitting  was  obtained  as 
described  in  Section  3  by  using  the  utility  program  COLSAC  [1].  The  model 
equation  (5.2)  was  formulated  in  the  form 

F  =  a+b/VB  -  Apt Ah  =  0,  (5.3) 

where  a  and  E  were  treated  as  data,  and  B,  Ap,  and  AH  as  index  variables.  In 
particular,  the  i-th  observation  set  (B,,  Ap,,  Api ,)  was  used  in  the  form  of  the 
constraint 

F,  -  <«  +  cai)  +  (&+  cbl)/y/B,  -  Api/Afi,  =  0  ,  (5.4) 

where  a  and  b  are  the  apex  values  of  the  model  parameters  a  and  E, 
respectively,  and  a  +  cm  and  b  +  cj,,  are  a  set  of  particular  parameter  values 
which  satisfy  the  i-th  constraint  equation  (5.4).  The  least  squares  algorithm 
minimizes  the  objective  function 


W  - 


(Cai  »  Cj,,)  Pj 

i=l 


(5.5) 


where  Pj  is  the  panderance  matrix  of  the  parameter  vector  ( a,b ).  Because  Pj 
was  not  known,  an  iteration  was  carried  out  as  described  in  Section  3.  The 
iteration  end  condition  was  the  requirement  that  the  change  of  the  parameter 
apex  values  be  less  than  10~6  times  their  spread.  This  condition  was  judged 
to  be  sufficient  to  assure  that  the  inaccuracy  of  the  solution  caused  by  the 
termination  of  the  iteration  was  insignificant  in  comparison  to  its  fuzziness. 
Convergence  under  this  condition  was  achieved  in  24  iteration  steps.  The 
final  results  were  as  follows: 


a  =  -0.0727, 
b  =  2.1008, 


=  0.0936, 

tb  =  0.4001, 

Cgb=  -0.976  693  7, 


) 
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(5.6) 


where  c ^  is  the  concordance  between  a  and  E.  The  quoted  spreads  sa  and  st¬ 
and  the  concordance  were  used  as  input  for  the  fitting  program,  that  is,  at 
the  final  step  we  assumed  that  the  fuzziness  of  the  model  parameters  were 
given  by  Eq.  (5.6),  and  the  apex  values  a  and  b  were  not  known.  Then  the 
program  produced  the  values  of  a  and  b  in  Eq.  (5.6)  with  panderances 
computed  by  the  panderance  propagation  formula  from  the  input.  The 
spreads  thus  computed  were,  of  course,  smaller  than  the  input  by  the  factor 
4>o,  the  zero-level  dilator.  In  the  present  example  the  value  of  the  dilator  was 

$0=  3.317.  (5.7) 

Because  the  input  panderance  matrix  was  iteratively  determined,  the 
concordance  C&  between  the  fitted  function  parameters  is  equal  to  the  input 
concordance  between  the  fuzzy  model  parameters,  given  by  Eq.  (5.6). 

Figure  2  displays  the  results  of  the  model  fitting.  It  shows  the 
observed  points,  and  the  fitted  curve  with  its  spread.  (The  spreads  in 
Figure  2  were  calculated  using  the  panderance  propagation  formula  (B.17)  for 
the  function  API  A^~  a  ■¥  b/Bv2.  The  plots  show  the  inverse  AH/AP  of  that 
function  with  its  spreads.  Because  the  inverse  is  not  a  linear  function  of  the 
parameters,  a  direct  computation  of  the  spread  of  A^/  AP  =  BV2/(aBv2  +  b) 
would  give  slightly  different  results,  and  be  only  an  approximation.  AP ( AH 
is,  on  the  other  hand,  linear  with  respect  to  a  and  b,  and,  therefore,  the 
panderance  propagation  and  discord  formulas  are  exact  for  this  function). 
The  solid  lines  on  both  sides  of  the  fitted  curve  indicate  the  support 
boundaries  of  its  membership  function  if  the  dilator  <t» q  is  used.  Notice  that 
the  magnitude  of  the  dilator  is  determined  by  the  observation  at  B  ~  8.3.  The 
support  boundary  passes  through  that  observation.  If  one  specifies  instead  of 
zero  a  compatibility  grade  of  0.3,  then  the  spread  of  the  fitted  function  has  to 
be  further  increased  such  that  the  minimum  membership  value  of  all 
observations  is  0.3.  The  corresponding  dilator  is 

*0.3  =  4-738  .  (5.8) 

The  support  boundaries  corresponding  to  this  dilator  are  shown  in  Figure  2  as 
dotted  lines. 

Through  each  observation  in  Figure  2  we  have  plotted  a  short 
segment  of  that  curve  of  the  fuzzy  set  of  solution  curves  which  passes 
through  the  observation  and  has  the  highest  membership  value.  (It  is  given 
by  the  parameter  values  «  +  ca,  and  b  +  C}.,  ). 

One  notices  in  Figure  2  that  the  spread  of  the  fitted  function  is  quite 
large  for  larger  values  of  B,  and  that  this  increase  of  the  spread  is  not 
consistent  with  the  scatter  of  the  observations.  The  increasing  trend  of  the 
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spread  of  course  correctly  reflects  the  uncertainty  of  the  function  in  the  region 
with  few  data.  The  magnitude  of  the  spread,  that  is,  the  dilator  <t>0  is, 
however,  generally  determined  by  few  outliers.  Thus,  in  the  present  case  an 
observation  at  B  ~  8.3  is  causing  the  large  value  of  <t> q.  The  fitted  function 
would  change  little  if  that  observation  were  discarded,  but  the  spread  would 
be  reduced.  Therefore,  one  easily  could  obtain  a  less  fuzzy  fitted  model  if  this 
observation  and  other  outliers  were  discarded.  Another  possibility  to  reduce 
the  fuzziness  of  the  fitted  model  is  an  adaptation  of  the  spread,  as  described 
in  Section  4.  We  achieve  such  an  adaptation  by  constructing  a  modulator 
function  4>7(B)  instead  of  a  constant  dilator  <Py.  Using  such  a  function,  the 
panderance  matrix  Pjp  of  the  parameters  of  the  fitted  function  is  computed  by 

Ptf(B)  =  <t>?(B)Pr  ,  (5.9) 

and  the  spread  of  the  fitted  function  is  computed  using  Ppp(B)  instead  of  the 
constant  <t>2P]-  or  *^03  Pj  •  as  *n  Figure  2.  In  the  present  example,  different 
functions  *1*  o  3(B )  were  computed  for  positive  and  negative  spreads, 
respectively.  The  form  of  both  functions  was 

d>(B)  =  max  {  1  ,  a  +  (B  -  Bq)2  3  }  ,  (5.10) 

and  the  parameters,  a,  B0  and  0  were  determined  such  that  the  membership 
value  of  the  fitted  function  (5.2)  was  at  least  0.3  for  each  observation. 

Figure  3  shows  the  result  of  the  fitted  function  with  the  modulated 
spread.  The  solid  lines  indicate  the  limits  of  the  support  of  ^ p  -  0.3,  where 
H-p  is  the  membership  function  of  the  fitted  function.  The  dotted  lines  are  the 
limits  of  the  support  of  njr.  The  spread  of  the  model  is  more  reasonable  than 
in  Figure  2,  and  consistent  with  the  observed  scatter  of  data. 

Figure  4  illustrates  the  described  model  fitting  in  the  parameter 
space.  The  result  of  the  fitting  is  a  fuzzy  vector  with  the  components  a  and  b 
and  a  panderance  matrix  given  by  Eq.  (5.6).  The  support  of  the  membership 
function  of  the  fuzzy  model  parameter  is  an  ellipse.  Figure  4  shows  the 
ellipse,  dilated  by  <X>0  3»  as  a  solid  line.  The  level  line  1*7-  =  0.3  is  shown  in  the 
figure  as  a  dotted  ellipse.  The  figure  also  contains  the  locations  of  the 
parameter  vectors  7  +  c,  which  correspond  to  each  of  the  22  observations. 
One  notices  that  all  of  the  latter  vectors  are  inside  the  dotted  ellipse,  as 
required  by  the  calculation  of  the  dilator  <fo3-  (The  different  symbols  in  this 
and  the  previous  figures  indicate  different  combinations  of  projectile  and 
target  materials). 

Next,  we  present  the  second  example  with  a  linear  fitting  function 


1C 


Figure  3.  Model  of  Crater  Size  with  Adapted  Spread 


(5.11) 


4 

s  =  2  *ixt  / 
i  =  1 

and  data  taken  from  Heshmaty  and  Kandel  [4].  Table  2  gives  a  summary  of 
the  data.  (A  detailed  discussion  of  their  sources  and  significance  is  given  in 
[4]  and  will  not  be  repeated  here).  The  purpose  of  this  model  fitting  is  to 
provide  an  estimate  of  S  (a  total  sales  value)  for  the  years  beyond  1980,  for 
projected  values  of  the  A  particular  set  of  projected  values  for  the  years 
1981-1988  which  was  used  in  [4]  also  is  listed  in  Table  2. 

The  fuzzy  parameter  vector  A  = :  {A,,  P^}  of  the  model  (5.11)  was 
determined  as  described  in  Section  3,  again  using  the  least  squares  utility 
program  COLSAC.  The  panderance  matrix  of  A  was  determined  by  iteration. 
In  this  example  the  iteration  end  criterion  was  satisfied  after  52  iteration  steps, 
whereby  an  overrelaxation  factor  1.7  was  used.  The  resulting  model 
parameter  vector  A  is  listed  in  Table  3  together  with  the  model  parameter 
vector  Ahk.  which  was  found  by  Heshmaty  and  Kandel  [4]  using  a  different 
approach.  The  latter  model  with  the  parameter  vector  A is  supposed  to  fit 
the  data  for  the  years  1975  through  1981  with  a  compatibility  grade  0.5. 
However,  a  test  calculation  shows  that  the  model  does  not  fit  the  data  for  the 
year  1975.  (See,  e.g..  Table  4  or  Figure  6).  Therefore,  in  order  to  have  a  fair 
comparison  between  Heshmaty  and  Kandel  results  and  results  by  the  present 
approach,  we  only  fitted  the  11  data  sets  for  the  years  1976  through  1981. 
Table  4  shows  that  our  model  also  fits  the  data  for  the  year  1975  with  a 
compatibility  grade  0.77,  but  this  is  coincidental.  We  also  note  in  passing  that 
the  two  data  sets  for  the  year  1975  were  found  to  be  influential  for  the  model 
fitting,  that  is,  their  inclusion  in  the  data  base  substantially  changes  the  fitted 
model  parameter  A  . 

Comparing  our  parameter  vector  A  with  the  parameter  vector  A{j% 
one  notices  two  essential  differences.  (See  Table  3).  First,  the  coefficient  A4 
of  the  price  of  microcomputers  has  a  negative  apex,  whereas  A^4  is  positive. 
Hence  our  model  predicts  an  increase  albeit  small  of  the  total  sales  volume 
(in  $)  if  the  price  of  microcomputers  decreases.  This  might  have  some 
economic  significance.  More  important  for  the  mathematical  aspect  of  the 
model  fitting  is  the  fact  that  is  a  degenerated  fuzzy  vector  with  only  one 
fuzzy  component.  This  means  that  the  estimated  spread  of  the  computed 
sales  volume  =  2  ^HKixi  only  is  affected  by  z3.  This  seems  to  be  a 
somewhat  artificial  situation,  which  can  lead  to  overconfidence  in  the 
accuracy  of  the  model  if  it  is  used  for  extrapolation  in  the  variables  Zj,  z3,  or 
z4.  In  contrast  to  this  situation,  all  components  of  a  least  squares  model 
parameter,  presently  of  A,  are  fuzzy  and,  consequently,  the  estimated  model 
spread  increases  whenever  any  of  the  arguments  Zj  through  z4  are  used 
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Table  2.  Economic  Data 


Year 

*1 

*2 

*3 

- 

x4 

^obs 

1975.0 

41.37 

3.0 

1375.0 

4100.00 

5855.50 

1975.5 

46.34 

15.5 

1622.5 

3600.00 

6852.40 

1976.0 

51.30 

28.0 

1870.0 

3100.00 

7849.30 

1976.5 

56.68 

45.5 

2285.0 

2893.50 

8727.20 

1977.0 

62.07 

63.0 

2700.0 

2687.30 

9605.10 

1977.5 

69.52 

81.5 

3100.0 

2522.65 

10984.80 

1978.0 

76.97 

100.0 

3500.0 

2358.00 

12364.50 

1978.5 

83.13 

140.0 

5208.0 

1847.75 

14124.00 

1979.0 

89.29 

180.0 

6916.0 

1337.50 

15883.50 

1979.5 

94.64 

407.0 

7878.0 

1313.15 

17845.05 

1980.0 

100.00 

634.4 

8840.0 

1288.80 

19806.60 

1980.5 

110.06 

832.9 

9728.5 

1191.30 

21798.20 

1981.0 

120.11 

1031.4 

10617.0 

1093.80 

23789.80 

1982.0 

135.00 

1390.0 

12600.0 

900.00 

- 

1983.0 

150.00 

1700.0 

14600.0 

800.00 

- 

1984.0 

165.00 

3310.0 

16600.0 

700.00 

- 

1985.0 

180.00 

5260.0 

18600.0 

600.00 

- 

1986.0 

195.00 

7890.0 

20600.0 

500.00 

- 

1987.0 

210.00 

11835.0 

22600.0 

400.00 

- 

1988.0 

225.00 

_ 

17752.0 

_ 

24600.0 

300.00 

- 

The  data  are  taken  from  Heshmaty  and  Kandel  [4]. 

x j  =  User  population  percent  expansion 

x2  =  Microcomputer  sales,  106  $ 
x3  =  Minicomputer  sales,  106  $ 
x4  =  Price  of  microcomputer,  $ 

SQ^s  =  Sales  of  computers  and  peripheral  equipment,  106  $ 


The  data  (x:  through  x4  and  S  ^s)  for  the  years  1975  through  1981  are 
actual  observations  from  different  sources.  The  values  of  Xj  through  x4 
for  the  years  1982  through  1988  are  projected. 
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Table  3.  Economic  Model  Parameters 
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Apex  Coordinates  and  Spreads  of  Model  Parameters 


Concordance  Matrix  of  A 


f  '• 

/  0.498100 

\  *0.953341 
\  -0.954762 


0.498100  -0.953341 

1.  -0.720295 

-0.720295  1. 

-0.292541  0.834829 


-0.954782  \ 
-0.292541  \ 

0.834829  / 
1*  / 


The  apex  coordinates  A^i  and  spreads  suKi  are  due  t0  Heshmaty  and 

Kandel  [4].  The  concordance  matrix  of  Ahk  is  the  unit  matrix.  The 
dilator  for  the  model  A  with  a  compatibility  level  of  0.5  is 
4>0. 5  =  3.3166. 
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beyond  the  observation  interval.  The  different  behavior  of  both  models  is 
evident  from  Table  4,  which  shows  that  the  spread  of  S  increases 
substantially  over  that  of  S^x  for  the  years  after  1984,  thus  warning  a 
potential  user  of  the  economic  model  about  the  intrinsic  inaccuracies  of 
economic  forecasts.  We  notice  in  passing  that  the  estimated  spread  of  S  has 
been  calculated  under  the  assumption  that  the  projected  values  of  xt  are  crisp. 
The  formalism  of  panderance  propagation  (see  Appendix  B)  permits  one  also 
to  take  into  account  the  spreads  (and  concordances)  of  the  projected  x,.  The 
resulting  spread  of  S  can  be  easily  calculated  and  would,  of  course,  be  larger 
if  finite  spreads  of  the  x,  were  assumed. 

The  results  of  the  fitting  are  shown  graphically  in  Figures  5  through 
8.  Figures  5  and  6  show  the  data  fitting  quality  of  both  models  for  the  years 
1975  through  1981.  The  grade  of  compatibility  is  0.5  for  the  model  A  and  0.47 
for  the  model  A^K  (in  the  latter  case  disregarding  data  from  1975).  From  a 
practical  view  point,  both  models  fit  the  data  equally  well  although  our  model 
(Figure  5)  consistently  produces  smaller  differences  between  computed  S  and 
observed  S . 

Figures  7  and  8  show  the  predicted  sales  S  and  S^,  respectively, 
up  to  the  year  1988.  The  curves  on  both  sides  of  the  predicted  sales  volume 
curve  are  the  support  boundaries  of  S  and  Shk>  respectively.  One  notices  a 
divergence  of  predictions  after  1984,  and  also  an  increase  of  the  spread  of  S. 
The  spread  of  S^x  increases  only  moderately,  as  discussed  above.  We  also 
note  that  the  prediction  S^x  approximately  coincides  with  the  upper  support 
boundary  of  S,  that  is,  S^x  is  close  to  a  border  solution  of  the  fuzzy  least 
squares  result.  It  appears  that  the  increase  of  the  estimated  spread  of  S  for 
values  of  x,  outside  the  region  of  observations  is  an  advantage  of  the 
panderance  propagation  formalism,  which  is  used  in  this  paper. 

6.  SUMMARY  AND  CONCLUSIONS 

We  have  presented  an  efficient  and  flexible  method  for  the  fitting  of 
fuzzy  model  functions  to  crisp  data.  The  efficiency  of  the  method  is  achieved 
by  restricting  the  membership  functions  of  vector  data  to  a  class  of  conical 
functions,  and  by  using  a  least  squares  objective  function.  A  fuzzy  vector 
with  a  conical  membership  function  is  defined  as  a  set  consisting  of  an  apex 
vector  and  a  panderance  matrix  which  describes  the  spread  of  the  fuzzy  apex 
point.  We  have  derived  for  functions  of  such  vectors  a  panderance 
propagation  formula  which  is  exact  for  linear  vector  operations,  and  gives  an 
approximate  estimate  of  the  fuzziness  of  non-linear  differentiable  functions  of 
fuzzy  vectors. 
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Fuzzy  functions  we  define  in  the  present  context  as  sets  of 
functions  which  depend  on  fuzzy  function  parameter  vectors.  These 
parameter  vectors  again  were  assumed  to  have  conical  membership  functions. 
Each  element  of  the  parameter  set  defines  an  element  of  the  function  set  and 
we  assign  to  both  elements  the  same  membership  value.  We  do  not  assume 
that  the  functions  are  scalar,  thereby  achieving  general  applicability  of  the 
presented  approach  to  a  large  variety  of  problems.  By  setting  a  fuzzy  function 
equal  to  zero  (crisp  or  fuzzy)  one  obtains  a  fuzzy  equation.  Such  an  equation 
defines  a  fuzzy  hypersurface  in  Rn  (n  is  the  dimension  of  the  argument  vector 
of  the  function).  A  fuzzy  point  in  R„  is  defined  by  a  fuzzy  vector  and  is  a 
special  case  of  a  fuzzy  hypersurface.  Hence,  in  fuzzy  model  fitting  one  deals 
with  fuzzy  manifolds,  points  and  surfaces,  in  R„. 

We  introduce  a  structure  in  the  space  of  the  described  fuzzy 
manifolds  by  defining  a  discord  between  any  two  elements  of  the  space.  It  is 
a  measure  for  the  separation  of  the  elements.  A  concept  dual  to  the  discord  is 
the  collocation  of  two  elements.  We  use  the  concepts  of  discord  and 
collocation  to  express  a  desired  grade  of  compatibility  between  data  and  fitted 
model  by  a  convenient  formula.  The  objective  of  the  model  fitting  is  to  find 
such  a  fuzzy  hypersurface  in  the  space  of  observables  which  has  high 
membership  values  at  the  observed  points.  In  particular,  we  minimize  the 
sum  of  squares  of  the  deviations  of  these  membership  values  from  one 
Because  we  formulate  the  model  function  in  the  form  of  an  implicit  equation, 
we  can  interpret  the  problem  as  the  fitting  of  a  crisp  model  in  the  parameter 
space.  In  this  formulation,  and  because  the  parameter  vector  is  assumed  to 
have  a  conical  membership  function,  the  numerical  treatment  can  be  done 
using  available  software  for  general  least  squares  problems. 

We  presented  two  examples:  one  involves  a  non-linear  function  of 
the  observables  and  the  other  uses  a  linear  model  The  latter  case  was 
compared  with  results  published  by  Heshmaty  and  Kandel  (4),  who  used  a 
model  fitting  approach  developed  by  Tanaka  et  al  [5],  The  comparison 
shows  that  in  this  particular  example  our  method  produces  a  model  which  fits 
the  data  slightly  better  than  the  Heshmaty  and  Kandel  model,  but  the 
difference  is  not  significant.  A  more  important  difference  is  that  the  method 
by  Tanaka  et  al.  [5]  tends  to  generate  model  parameters  with  some  crisp  and 
some  fuzzy  components,  and  it  does  not  provide  estimates  of  the 
concordances  between  the  model  parameter  components  In  our  method  the 
model  parameter  only  has  fuzzy  components,  and  the  concordances  are 
explicitly  calculated.  As  a  result,  the  estimated  spread  of  fitted  model 
functions  typically  increases  as  any  of  the  observations  are  extrapolated.  In 
contrast,  Tanaka  et  al.  model  spread  is  insensitive  to  extrapolations  of  those 
observations  which  have  crisp  parameters  as  coefficients.  It  seems  that  our 
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estimated  spreads  are  more  reasonable,  because  they  would  draw  the 
attention  of  a  user  of  the  model  to  the  intrinsic  inaccuracies  of  extrapolation. 
In  comparing  our  model  with  Heshmaty  and  Kandel  calculations,  one  indeed 
observes  that  our  calculated  spread  does  include  the  Heshmaty  and  Kandel 
solution,  albeit  with  a  small  membership  value,  but  not  vice  versa. 

We  have  also  discussed  a  modulation  of  the  spread  and  shown  its 
application  in  the  first  example.  Such  a  modulation  might  provide  more 
realistic  spread  estimates  than  a  simple  application  of  the  panderance 
propagation  formula,  because  the  modulation  uses  more  of  the  available 
information. 

In  conclusion,  our  method  has  the  advantage  that  it  can  be  easily 
implemented,  using  available  software,  and  is  not  restricted  to  any  special 
form  of  the  model  function.  The  method  produces  estimates  of  model 
spreads  that  in  the  example  are  more  reasonable  than  those  obtained  by 
Tanaka  et  al.  [5].  Restrictions  of  our  method  are  due  to  the  requirement  of 
conical  membership  functions.  This  restriction  is  essential  for  the  efficiency  of 
the  solution  algorithms. 

The  tools  and  concepts  developed  for  the  present  problem  also  can 
be  used  to  develop  solution  methods  for  the  more  general  problem  of  fitting  a 
fuzzy  model  to  fuzzy  data.  If  estimates  of  the  spreads  of  model  parameters 
and  data  are  available  then  such  an  extension  is  a  straight  forward  application 
of  the  present  results.  If,  however,  these  spreads  are  to  be  estimated 
concurrently  with  the  model,  then  more  development  is  needed,  because  the 
simple  iteration  described  in  this  paper  cannot  be  applied  to  such  problems. 
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Appendix  A. 

FUZZY  EQUATIONS 


Let  X  €  Rn  and  let  F(X)  €  Rr  be  a  continuously  differentiable 
function  of  X.  The  crisp  equation 

F(X)=  0  (A.l) 

defines  in  Rn  a  (rt  -  r)-dimensional  hypersurface  Xp.  The  equation  can  be 
fuzzified  either  by  a  fuzzification  of  the  function  F  yielding 

F (X)  =  0  ,  (A. 2) 


or  by  replacing  the  crisp  right  hand  side  by  a  fuzzy  zero,  that  is, 

F(X) =  0  . 


(A.  3) 


In  the  former  case  one  has  a  set  of  functions  equaling  zero,  and  a 
corresponding  set  of  solutions.  From  these  solutions  one  may  construct  a 
fuzzy  domain  in  R„  which  represents  the  fuzzy  solution  X  p  of  Eq.  (A. 2).  In 
the  case  of  Eq.  (A. 3)  one  has  a  crisp  function  F(X)  which  is  set  equal  to 
different  values  close  to  zero.  Each  equation  produces  a  solution  Xp,  and  the 
set  of  these  solutions  is  the  solution  of  Eq.  (A. 3).  One  can  formally  transform 
the  latter  equation  into  an  equation  of  the  same  type  as  Eq.  (A. 2)  by  defining 
a  fuzzy  function 

G(X)  =  F(X)  -  0  (A. 4) 


and  setting 


G  (X)  =  0  . 


(A. 5) 


We  shall  first  discuss  the  more  general  Eq.  (A. 2),  and  later 
demonstrate  that  the  solution  of  Eq.  (A. 5)  indeed  is  identical  to  the  solution  of 
Eq.  (A. 3). 


We  define  the  fuzzy  function  F  in  terms  of  a  fuzzy  parameter  vector 
T.  Because  we  only  consider  vectors  with  conical  membership  functions,  T  is 
defined  by 

f  «:  {  T,  PT  }  ,  (A. 6) 

where  T  €  Rp  is  the  apex  of  T  and  Pp  is  its  panderance  matrix.  {  Pj  is  a 
positive  definite  (p  x  p)-matrix).  The  membership  function  up  of  T  is  defined 
as  follows 


(A. 7) 
(A.  8) 


ll<-Tiir  =  [(t-T)r  Pf1  (t-T)]1*  , 
p,j-(f)  =  1  ~  min  {  1  /  !lf  — Tllj  }  . 
The  fuzzy  function  F  we  define  by 

F(X)=  F(X,T) 

with  the  membership  function 

H(F(X,0)  “  MO  • 


(A.  9) 


We  also  assume  that  F(X,t)  is  continuously  differentiable  with  respect  to  X  as 
well  as  with  respect  to  t.  The  Jacobian  matrices  of  the  derivatives  we  denote 
by  subscripts: 

dF/dX  =  Fx  ,  dF/dt  =  F,  .  (A. 10) 


Each  element  of  the  fuzzy  set  of  equations  (A. 2),  i.e.,  each  crisp 

equation 


F(X,f)  =  0 


(A. 11) 


with  fixed  t  defines  a  crisp  relation  between  components  of  X.  We  assign  to 
that  relation  the  membership  value  nj-(t).  On  the  other  hand,  for  any  fixed  X 
one  has  a  set  (possibly  an  empty  set)  of  parameters  t  which  satisfy  Eq.  (A.  11). 
We  assign  to  X  the  highest  membership  value  of  that  set: 


Mx)  =  max  MO  .  (A. 12) 

t  :F(X,t)  =  0 

The  fuzzy  solution  Xp  of  Eq.  (A. 2)  then  is  defined  as  a  set  in  RK  with  the 
membership  function  (A. 12). 

An  equivalent  but  more  convenient  definition  of  n-f(X)  is  in  terms 
of  a  separation  measure  h  of  X  from  Xp: 

h(X,Xp)=  min  l!t-T  j, 

t  :  F  (X,t)  -  0 

MX)  =  1  -min  {  1  ,  h(X,Xp)  } 

To  be  definite,  we  assign  an  infinite  value  to  h(X,  X p)  if  F  (X ,  t) 
solution  t  for  the  given  X. 

Now  we  derive  an  approximate  expression  for  the  separation 
h(X,  Xp).  To  that  end  we  reformulate  Eq.  (A. 13)  as  the  following  constrained 
minimization  problem: 


(A. 13) 

(A. 14) 
=  0  has  no 
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minimize 


subject  to 


W  =  ( t-T ?  Pfl(t-T), 


F(X,t)  =  0. 


(A.  15) 


To  solve  this  problem  we  use  a  Lagrange  multiplier  vector  k  and  obtain  the 
modified  objective  function 


W  =  j  (t-T?  Pf' (t-T)  -  kT  F(X,t)  . 


(A. 16) 


We  obtain  normal  equations  for  the  minimization  problem  by  setting  equal  to 
zero  the  derivatives  of  IV  with  respect  to  t  and  k.  The  normal  equations  are 


Pf1-  (t-T)  -  Ff(X,t)  k  =  0  , 
F(X,t)  =  0  . 


(A.  17) 


Eliminating  k  from  the  first  equation  (A.  17)  one  obtains  the  equivalent  set  of 
equations 


(t-T?  Pfl(*-T)=  (t-T?  Fj  (FtPrFjrlFt  (t-T), 


F(X,t)  =  0  . 


(A. 18) 


(We  exclude  singular  cases  by  assuming  that  the  matrix  FtPjFj  is  positive 
definite.)  The  left  hand  side  of  the  first  equation  (A. 18)  is  the  sought  for 
minimum  value  of  Ft  -  T  j.  On  the  right  hand  side,  the  arguments  of  Ft  are 
(X,t),  and  therefore,  it  only  can  be  computed  after  a  numerical  solution  of  Eq. 
(A. 17)  or  (A. 18).  However,  an  approximate  solution  can  be  obtained  by 
linearizing  the  second  equation  (A. 18)  in  the  form 

F(X,t)  =  F(X,T)+  F,(X,T)(t-T)  =  0.  (A. 19) 

Substituting  this  into  the  first  Eq.  (A. 18)  and  also  using  the  arguments  ( X,T ) 
instead  of  (X,f)  in  the  product  Ft  Pj  Fj,  one  obtains 


h(X,XF)=  (  Ft  -  Tl'r  )mi„  ~  [  Ft  (FtPjFj )_1  F  ]ia  , 


(A. 20) 


where  the  arguments  of  F  and  Ft  are  (X,T).  The  expression  (A. 20)  is  exact  if 
F  is  a  linear  function  of  the  the  parameter  f.  (In  that  case,  also  Eq.  (A. 19)  is 
exact  with  F{  evaluated  at  (X,T).)  The  solution  XF  is  approximately  given  by 
Eqs.  (A. 20)  and  (A. 14). 

Now  we  consider  the  fuzzy  Eq.  (A. 3)  and  show  that  Eqs.  (A. 20)  and 
(A. 14)  also  provide  a  solution  to  that  equation.  Let  the  right  hand  side  of  Eq. 


(A. 3)  be  the  fuzzy  vector 


0  =:  {  0,  P0}  .  (A. 21) 

We  construct  a  solution  of  Eq.  (A. 3)  as  follows.  First,  we  define  a  separation 
of  F(X)  from  the  fuzzy  zero  by 

h(F, 0)=  [  FrP0-1F  l172  ,  (A. 22) 

and  a  separation  of  any  X  from  the  solution  X  q  of  Eq.  (A. 3)  by 

h(X,X0)  =  ft(F(X),o}  =  [F(X)TPolF(X)]m  .  (A. 23) 

The  solution  of  Eq.  (A. 3)  then  is  the  fuzzy  set  with  the  membership  function 

M-o(X)  =  1  -  min  {  1  ,  /t(X,X0)}  .  (A. 24) 

One  obtains  exactly  the  same  fuzzy  set  as  a  solution  of  Eq.  (A. 5)  by  applying 
the  formula  (A. 20)  and  Eq.  (A. 14)  to  the  function  G(X),  defined  by  Eq.  (A. 4). 
Therefore,  general  fuzzy  equations  always  can  be  assumed  in  the  form  (A. 3), 
i.e.,  with  a  crisp  zero  on  the  right  hand  side.  We  note  that  in  the  case  (A. 4) 
the  formula  (A. 20)  is  exact,  because  G(X)=F(X)-0  is  a  linear  function  of  the 
fuzzy  parameter  0. 

We  have  shown  that  the  solution  of  a  fuzzy  equation  is  a  fuzzy  set 
(a  fuzzy  (n  -  r)-dimensional  hypersurface  in  Rn).  Its  membership  function  can 
be  computed  by  solving  Eq.  (A. 13)  pointwise,  or  by  the  approximate  formula 
(A. 20).  We  note,  however,  that  the  membership  function  of  the  solution  Xp 
depends  on  the  formulation  of  the  function  F(X).  Two  algebraically 
equivalent  formulations  of  F(X)  =  0,  involving  the  same  fuzzy  parameter  T 
and  having  the  same  crisp  solution  X(T)  of  F(X,T)  =  0,  generally  produce 
different  fuzzy  solutions.  These  solutions  have  the  same  apex,  namely  the 
(n  -  r)-dimensional  crisp  hypersurface  X(T),  but  their  spreads  can  be  different. 
The  fact  that  the  solution  depends  on  the  form  of  the  equation  is  an  intrinsic 
property  of  fuzzy  equations. 

Now  we  discuss  the  structure  of  the  fuzzy  solution  Xf  of  F(X)=0. 
It  is  provided  by  Eq.  (A. 13)  which  defines  a  distance  between  an  X  and  Xf. 
That  distance  is  zero  if  X  is  a  point  of  the  apex  X(T)  of  Xp,  i.e.,  of  the 
solution  of  F(X,T)  =  0.  The  corresponding  membership  value  of  X  is  one. 
Boundaries  of  the  regions  in  Rn  where  up  (X)^y  are  hypersurfaces  defined  by 
the  equation  h(X,Xp)=l-y.  We  investigate  the  surfaces  by  using  the 
approximate  formula  (A. 20). 

Let  Y  be  a  point  of  the  hypersurface  X(T).  Then  Y  satisfies  the 
equation  F(Y, 7)=0,  which  we  expand  obtaining 
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F(X,T)  =  FX(Y,T)'  ( X-Y ) + 


(A. 25) 


since  F(Y,T)  =  0.  Substituting  the  linear  term  of  the  expansion  in  Eq.  (A. 20) 
for  F,  one  obtains  for  the  distance  between  any  crisp  X  and  a  fuzzy  Y  f  Xp 

.1/2 


MX, Y)~  [(X-Y)tf£  (FtPTFj)-xFx  (X-Y)] 


(A. 26) 


The  structure  of  the  hypersurface  h(X,Y)=l -y  is  determined  by  the  (nxn)- 
matrix 

Pf1  =  FJX  (FfPj-Ff1)"1  ?X  •  (A- 27) 

We  recall  that  F  (  Rr  and  rsfi.  The  rank  of  the  matrix  Py 1  is,  therefore,  at 
most  equal  to  r.  (It  equals  r  if  the  components  of  F  are  linearly  independent 
functions  of  X.  We  assume  for  simplicity  that  this  is  the  case.)  If  r=n,  then 
the  solution  Xp  is  a  fuzzy  point  in  R„  ,  and  the  surface  h  =  l-*y  is  a 
hyperellipsoid.  If  r<n  then  the  matrix  P-jT1  is  semi-definite  and  the  surface  is 
a  hypercylinder  with  rulings  that  are  parallel  to  the  hypersurface  F  ( X,T)-0  at 
X  =  Y.  The  support  boundaries  of  p.p(X)-y  are,  therefore,  surfaces  that  are 
approximately  parallel  to  the  apex  X(T),  of  the  solution,  at  least  for  y  close  to 
one. 
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Eq.  (A. 20)  provides  a  measure  for  a  distance  between  a  crisp  point 
X  and  the  fuzzy  set  Xp.  The  distance  between  a  fuzzy  point  A  and  Xp  may 
be  measured  by  the  discord  between  both  sets.  We  define  the  discord  in 
analogy  to  Eq.  (2.15)  by 

D(A,Xf)  =  min  max  {  h(X,A)  ,  h(X,XF)  }  .  (A. 28) 

X(Ra 

In  some  special  cases,  for  instance,  if  the  function  F(X)  is  scalar,  the 
discord  can  be  computed  by  an  explicit  formula  which  now  will  be  derived. 

Let  A  be  a  fuzzy  point 

A  =:  {  A,Pa  }  .  (A. 29) 

The  separation  of  an  X  €  Rn  from  A  we  measure  by  h  (X,  A)  ,  defined  by 

h(X,A)  =  [  (X-A)r  P^1  (X-A))m  .  (A. 30) 

The  separation  of  X  from  the  solution  Xp  of  F(X)  =  0  we  measure  by 

MX,Xf)=  [  Ft  (FtPpFj )-1  F  ]’/2  .  (A. 31) 

Because  h(X,A)  is  a  convex  function  and  ,*i(X,Xp)  is  not  concave  (we 
assume  that  the  approximation  (A. 26)  is  sufficiently  accurate),  the  search  for 
the  minimum  over  X  in  Eq.  (A. 28)  can  be  restricted  to  the  locus  where 
h  (X ,  A)  =  constant  is  tangent  to  h  (X ,  Xp)  =  constant.  In  the  special  case 
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where  that  locus  is  a  straight  line,  D(A,  X  p)  can  be  easily  calculated.  We 
now  consider  that  special  case.  First  we  determine  the  point  B  at  which  the 
hypersurface  F(X,T)=0  is  tangent  to  a  hyperellipsoid  h(X,A)  =  constant. 
Then  we  shall  consider  the  straight  line  between  B  and  A,  and  establish 
conditions  for  it  being  the  above  mentioned  locus. 


We  find  B  by  solving  the  problem 
minimize 

(B-A)t  Pa'  IB -A) 

subject  to 

F(B)  =  0  . 


(A. 32) 


Using  a  Lagrange  multiplier  vector  k  we  obtain  a  modified  objective  function 


w  =  i(B-A)r-  Pa'-  (B-A)  -  kT  F(B)  , 

(A. 33) 

and  the  normal  equations 

Pa'  -  (B-A)  -  Fjc  k  =  0  , 

F  =  0  . 

(A. 34) 

Eliminating  k  from  the  first  equation,  one  finds  the  relation 

B-A  =  PA  Ftx  ( FXPAFTX  )~'Fx-  ( B-A ) 

(A. 35) 

which,  using  the  approximation 

F(B)  =  0  =  F(A)  +  Fx  (B-A)  , 

(A. 36) 

reduces  to 

B-A  -  ~  Pa  FTx  ( FXPAFTX y'  F  , 

(A. 37) 

where  F  and  Fx  are  evaluated  at  A.  The  separation  of  B  from  A  is 

h(B,A)=  Ft  (  FxPaFx  )~'  F 

(A. 38) 

Hence,  in  order  to  approximately  calculate  the  separation,  one  does  not  have 
to  actually  calculate  B. 


Let  C  be  a  point  on  the  straight  line  through  A  and  B.  Then 

C  -  A  =  a{B  -  A)  .  (A. 39) 

The  tangent  plane  to  h  (X ,  A)  =  constant  through  C  is  spanned  by  vectors  X-C 
which  satisfy  the  equation 
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(C  -  A)tPa:{X  -  C)  =  0  (A. 40) 

Substituting  Eqs.  (A. 39)  and  (A. 37)  in  this  equation  one  obtains  the  equivalent 
expression 

a Ft(FxPaFtx)~'Fx-  {X  -  C)  =  0.  (A. 41) 

The  tangent  plane  to  h(X,  X  p)  =  const,  through  the  same  point  C  is  spanned 
by  vectors  X-C  which  satisfy  the  equation 

FT(FtPTFf)~1Fx- (X  -  C)  =  0,  (A. 42) 

see  Eq.  (A. 26).  Comparing  Eqs.  (A. 41)  and  (A. 42)  one  sees  that  necessary 
and  sufficient  for  both  equations  to  define  a  common  tangent  plane  is  that 
there  exists  a  positive  number  3  such  that 

3  F<PtF!  =  FxPaF$.  (A. 43) 

This  condition  is  satisfied  if  F  is  a  scalar  function.  Another  case  in  which 
(A. 43)  is  satisfied  is  the  function  F  =  X-B,  that  is  Xp  is  the  fuzzy  point 
B  =:  {  B,  PB  },  and  PB  -  Pr  =  $PA. 


We  now  assume  that  (A. 43)  is  satisfied  along  the  straight  line.  We 
have  then  at  the  point  C 


h{C,A)=  |  or  |  •  [  (B  —  A  )^  P  A^  (B  —  A)]l/3  = 
=  | a |  •  h(B.A)  , 


(A. 44) 


where  h( B,  A)  may  be  computed  by  Eq.  (A. 38).  For  the  same  point  C  one 
obtains 


h(C,XA)  =  [  F(C)r  (  FfPrFfr  J-1-  F(C)  l1 2  = 
~  | a  -  1 1  •  h(A,Xp)  , 


(A. 45) 


where  h{A,Xp)  may  be  computed  by  Eq.  (A. 31).  Keither  of  the  equations 
actually  requires  to  know  the  value  of  B.  Restricting  the  search  for  a 
minimum  in  Eq.  (A. 28)  to  the  straight  line  between  A  and  B,  that  is  to  a 
between  zero  and  one,  we  first  determine  the  value  of  a  for  which 
h(C,  A)  -  h(C,  Xp).  The  corresponding  value  of  h  is  equal  to  the  discord 
(A. 28).  One  finds  after  simple  algebra 


h(B,A)  •  h(A,X  F) 
h(B,A)  +  h(A,XF) 


(A. 46) 


The  grade  of  collocation  between  a  fuzzy  point  A  and  the  fuzzy 
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1 


f, 


solution  X p  of  F(X)  =  0  we  define  in  terms  of  the  discord  by 
y  ( A,Xf )  =  1  -  min  {  1  ,  D(A,XF)  }  . 


(A. 47) 
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Appendix  B. 

PANDERANCE  PROPAGATION  FORMULA 

Let  X,Z  €  Rn,  and  let  the  linear  function 

Z  =  D-  X  +  Z0  (B.l) 

be  a  coordinate  transformation.  Let  A  =:  {  A,  PA  }  be  a  fuzzy  point  in  the  X- 
coordinate  system.  We  seek  its  representation  B  =:{B,Pg}  in  the 
transformed  Z-coordinate  system.  The  transformation  formulas  are 

B  =  D  -  A  +  Zn  (B.2) 


Ps  =  DPaDt  .  (B.3) 

Eq.  (B.3)  may  be  called  a  panderance  propagation  formula.  It  can  be  readily 
verified  by  substitution.  By  definition  one  has  (see  Section  2)  the  membership 
functions 

nA(X)=  1-  min{  1,  [(X-A)tPa-1(X-A)]1/J}  (B.4) 


Kb(2)=  1  -  min  {  1  ,  [(Z  -  B)T  PB~' (Z  ~  B)  f*  } 


We  have  to  show  that 


and  this  is  true  because 


M-b(  Z(X)  )  =  PA(X)  , 


(Z-B)r  Pg'1  (Z-B)  = 

=  (X  -  A)t  Dt  [  (D1)"1  PAl  D~l  ]  D  (X  -  A)  =  (B.7) 

=  (X-A)r  PX'(X-A)  . 

j 

The  panderance  propagation  formula  (B.3)  componentwise  satisfies 
the  extension  principle  [7].  In  order  to  show  this  we  consider  one  component 
of  Eq.  (B.l),  say. 


Let  the  corresponding  component  of  Eq  (B.2)  be 


b  =  d1  A  +  z  q 


(B  9) 


The  panderance  of  the  fuzzy  number  b  = :  {  b,  Pb  }  is,  according  to  Eq  (3.3) 

Pb  =  dT  PAd  < B.  10) 

and  its  membership  function  is 

Mz)  =  1  -mir.  {  1  ,  |z-t  |  /  y/Ft  }  (B.ll) 


On  the  other  hand,  according  to  the  extension  principle  one  should  have  the 
relation 


jjl{.(z)  =  max 

X  :dT  X 


(B  12) 


‘0‘ 


We  find  the  maximum  on  the  right  hand  side  of  eq  (B.12)  by  solving  the 
minimization  problem 


minimize 


(X-A)t  PaX(X-A) 


subject  to 


dT  (X  -A)  -  z  +  b  -  0 


(B  13) 


Using  the  Lagrange  multiplier  k  we  obtain  a  modified  objective  function 
W  =  i(X-, 
and  the  normal  equations 


W=  i(X  ~A)TPa1  (X -A)  -  lt[  dT(X -A)  -  z  +  b  ]  (B.  14) 


Pa 1  (X-^)  -  k  d  =  0, 


(B.15) 


d-  (X  -  A)-  z  +b  =  0  . 

Eliminating  k  from  the  first  equation,  one  obtains 

Pa1(X-A)=  d  [dT(X-A)]/(dTPAd)  .  (B.16) 

Multiplying  from  left  by  (X  -  A)T  and  using  the  second  Eq.  (B.15)  one 


obtains  from  (B.16) 

[  {X  —  A)7  Pa^(X  -  A)  jjrtn  =  (z  -f>)2  /  P(-  , 
the  square  root  of  which  is  equal  to  the  expression  in  Eq.  (B.ll). 


(B. 17) 
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Hence  we  have  shown  that  the  panderance  propagation  formula 
(B.3)  is  consistent  with  the  extension  principle  for  any  linear  function,  even  if 
the  matrix  D  in  Eq.  (B.l)  is  not  a  (n  x  n)-matrix,  or  is  singular.  If  Pg  turns  out 
to  be  singular,  then  the  corresponding  support  of  is  a  degenerated 
hyperellipsoid. 


If  the  function  Z(X)  is  non-linear,  then  one  may  obtain  an 
approximate  by  linearizing  the  function.  In  particular  one  then  obtains 


Z(X-A)  =  Z(A)  +  —  (X-A)  +  ...  , 

B  =  Z(A)  , 

„  dZ  „  ,  bZ  J 

B  ax  ?A  ^  dX^  ' 


(B  18) 


where  dZ  / dX  is  the  Jacobian  matrix  of  the  function  Z(X),  evaluated  at  X  =  A  . 


As  was  shown  above,  the  spread  of  a  component  of  a  fuzzy  vector 
equals  the  square  root  of  the  corresponding  diagonal  element  of  the 
panderance  matrix.  A  convenient  representation  of  the  panderance  matrix  in 
terms  of  the  component  spreads  is  by  the  formula 

PA=  SACASA,  (B- 19) 

where  5,4  is  a  diagonal  matrix  with  the  spreads  of  components  of  A  as 
diagonal  elements.  The  matrix  CA  is  dimensionless,  has  ones  in  the  diagonal 
and,  if  PA  is  positive  definite,  the  off-diagonal  elements  of  CA  have  absolute 
values  less  than  one.  We  ^all  CA  the  concordance  matrix  of  A,  and  its  elements 
Cfc  the  concordances  between  components  a j  and  of  A .  Componentwise 
the  relation  (B.19)  is  for,  for  j,k  =  1,  ...,  n, 

Pjk  =  •  (B.20) 
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Appendix  C. 

NORMAL  EQUATIONS  AND  PANDERANCE  OF  MODEL  PARAMETERS 


We  consider  the  constrained  minimization  problem  (3.4a)  for  a 
fuzzy  model  and  crisp  data,  viz., 

minimize 

s 

w  =  2  c'r  pfl  c> 

i=i 

subject  to  (C  l) 

F,(X,,T+c,)  =  0,  i=  1,2 - s  . 


In  Eq.  (C.l)  the  c,  and  T  are  p-dimensional  vectors,  and  each  F,  is  an  r,- 
dimensional  function  of  the  observation  vector  X,  and  the  model  parameter 
t  =  T  +  c,.  However,  since  the  X,  are  crisp  and  not  subject  to  adjustment, 
they  can  be  included  in  the  definitions  of  the  F,,  which  then  may  be 
considered  as  functions  of  the  parameter  t  only.  We  assume  that  these 
functions  are  twice  differentiable  with  respect  to  all  components  of  t.  Using 
Lagrange  multiplier  vectors  k,  one  obtains  the  following  system  of  normal 
equations  for  the  problem  (C.l): 

P.-'c,  ~  {  •£-[*,7'F,(r+c;)]}r  =  0,i=  1,2 . s  , 


2  77 U!  P,(T  +  c,)]  =  0, 

i  ■=  l 

P,(T  +  c, )  =  0  ,  i  =  1,2,  . . .  ,  s 


(C.2) 


A  solution  of  Eq.  (C.2)  consists  of  the  model  parameter  vector  T,  the  s 
correction  vectors  (residuals)  c,,  and  the  s  Lagrange  multiplier  vectors  kt.  The 
solution  of  the  minimization  problem  (C.l)  is  among  the  solutions  of  Eq. 
(C.2).  Now  we  shall  discuss  the  numerical  solution  of  the  latter  equation. 


Eq.  (C.2)  is  non-linear  with  respect  to  the  unknowns  T  and  c,. 
Therefore,  its  numerical  solution  in  general  requires  an  iteration,  and  we 
present  iteration  formulas  based  on  Newton-Raphson  approach.  The 
formulas  are  obtained  by  an  expansion  of  Eq.  (C.2)  at  points  {c, ,*,,T}, 
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i=l,...,s,  which  represent  an  approximation  to  the  solution.  Let  corrections 
to  the  approximate  residuals  be  e,,  corrections  to  the  approximate  Lagrange 
multipliers  be  and  corrections  to  the  approximate  model  parameter  be  t. 
Then  the  linear  terms  of  the  expansion  yield  the  following  system  of  linear 
equations  for  the  corrections 

[I-P,  (*/>,)»]  «,  "  P,  (P,)tT  (*,■  +  «,■>  ~  P,  (kjF,)t t  t  -  -c,  . 

i-  l,2,...,s  , 


5  5  9 

2  (*.TPi>« «.• +  2  <F^r  <*«  •*■“.•> +  2  t  =  ° ' 

i » i  i=i  i=i 


(C.3) 


|  (F| )t  «i  +  (F,)t  t  =  -F,  , 

J  i  =  l,2,...,s  .  j 

» 

‘  In  Eq.  (C.3)  we  have  used  the  subscript  t  to  indicate  the  derivative  8/  dt  and 

*  the  subscript  tt  to  indicate  the  second  derivative  d2/dt2.  The  equation  system 

rearranged  by  algebraic  manipulations  to  obtain  more  convenient 
equations.  Now  we  formulate  such  a  set  of  equations,  and  define  to 
the  following  matrices  for  each  i  -  1,  2,...,  s 


may  be 
iteration 
that  end 


t 


t 


G  = 

A  = 

D  = 

r  = 

E  = 

N  = 


(FtPFfr)M  , 

P  FjG  F t  - 1  , 
P~lAP(kTF)tt  , 

[I  +  PD]'1  , 
r[Ac-PFjGF)  , 

fJgf(-  dt  a  . 


(C.4) 


The  rearranged  set  of  equations  is 


V 

? 

I 

» 

* 


^N,r  =  ^{(F.tfG,  [(F,)(C,  -  F,]  -  D,E,}  , 

i  - 1  «  -  1 

*<+  *«  =  G,  [(F ,)(C,  -  F,]  +  G,  (F , )t f/  +  P,  (*/>,)„]  t  - 

“  G,  (F,)(  P,  (fc,T F,)tt*i  , 


(C .  5) 


*i  =  E,  -  (r(A,  -t-  J)t  , 


i  =  1,2,. ..,s  . 


Numerical  experiments  show  that  the  convergence  of  the  iteration  is 
enhanced  if  Eq.  (C.5)  is  used  in  a  sub-iteration  mode,  iterating  alternately  t 
and  k  +  k  (with  fixed  c(),  and  Jc  +  k  and  c  (with  fixed  T),  respectively.  One 
obtains  a  Gauss-Newton  iteration  scheme  from  Eq.  (C.5)  by  dropping  all 
second  order  derivative  terms  (jtrF)(f. 


The  panderance  matrix  Pj  of  the  solution  vector  f  can  be  obtained 
in  terms  of  the  input  panderances  P,  by  using  the  linearized  panderance 
propagation  formula  (Appendix  B  ).  We  obtain  the  formula  by  first  expanding 
Eq.  (C.2)  at  the  solution  in  terms  of  t,  k,  and  t,,  and  eliminating  the  k,.  The 
result  is 


5 


XN' t  =  2n'*'  * 

i=i  i=i 


(C.6) 


giving  a  linear  relation  between  changes  of  c,  and  T.  Applying  the 
panderance  propagation  formula  (B.3)  or  (B.18)  to  this  relation  one  obtains 


Pt  =  (IN,)-1  (2n,p,nJ)  [(2N,)'1]1  •  (C.7) 

One  notices  that  the  linearized  formula  (C.7)  contains  the  second  order 
derivatives  {kT  F,)lt  of  the  model  functions  F,.  This  is  due  to  the  fact  that  the 
normal  equations  (C.2)  already  contain  first  order  derivatives  of  Fr  Their 
linear  expansion,  therefore,  includes  second  order  derivatives. 

The  formulas  (C.3)  through  (C.7)  describing  the  solution  algorithm 
of  the  problem  (C.2)  are  somewhat  simpler  than  the  corresponding  formulas 
for  a  general  least  squares  model  fitting  problem  [2],  because  the  F,  do  not 
depend  on  the  X,  in  the  present  case.  However,  the  simplifications  are  not  of 
such  an  extent  that  a  special  computer  program  would  be  much  more  efficient 
than  a  general  program.  One  may,  therefore,  solve  the  problem  (C.l)  with 
any  computer  program  for  least  squares  model  fitting  w'ith  implicit  constraint 
equations,  for  instance  the  COLSAC  program  described  in  [1], 
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